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(57) Abstract 

In accordance with the present invention, a mobile agent object (10) executes a first method (18) on a first computer (12), migrates 
from the first computer (12) to a second computer (14), and executes a second method (20) on the second computer (14). The first and 
second methods and first and second computers are designated in an itinerary (28). The agent includes both data (22) and executable code 
(24. 26) which are serialized for transmission from the first computer to the second computer as data. The data containing the agent is 
then deserialized in the second computer to regenerate the agent in the form of an object. The executable code portion of the agent can be 
supplemented with code from a home codebase located on another computer. 
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TITLE OF THE INVENTION 
ITINERARY BASED AGENT MOBILITY INCLUDING MOBILITY OF 

EXECUTABLE CODE 

CROSS REFERENCE TO RELATED APPLICATIONS 
A claim of priority is made to U.S. provisional patent 
application Serial Number 60/030,906, entitled USE AND 
COLLABORATION OF MOBILE AGENTS IN A COMPUTER NETWORK, filed 
November 14, 1996. 

STATEMENT REGARDING FEDERALLY SPONSORED RESEARCH OR 

DEVELOPMENT 
Not applicable 

BACKGROUND OF THE INVENTION 

The present invention is generally related to network 
computing, and more particularly to mobile objects. 

Mobile objects that are transmitted across a computer 
network are known. Mobile objects are comprised of code and 
data, both of which are transmitted across the computer 
network. Technologies such as client -server protocols, 
remote procedure call protocols, and distributed object 
technologies are employed to transmit mobile objects across 
the computer network. These technologies implement either 
a "push" model or a "pull" model, both of which have 
drawbacks. 

In a "pull" model the code for an executing object is 
downloaded from a network source such as a web server. When 
a particular portion of code becomes necessary for operation, 
that portion of code is first sought on the local filesystem. 
If the local filesystem does not include that portion of the 
code, a network request is sent to another computer in the 
network in order to prompt transmission of that portion of 
code to the local computer. However, as different classes 
of sub-objects are created, a separate network request must 
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be sent to retrieve code for each class. In the case of a 
Hyper-Text Transfer Protocol ("HTTP") request, each requesc 
must re-establish a Transmission Control Protocol/Internet 
Protocol ("TCP/IP") socket connection to the web server. 
Thus, when downloading a large number of classes, a large 
number of connections must be established and a large amount 
of network overhead is incurred. 

Another drawback associated with the pull model is that 
as an object travels, the code which enables the 'object to 
operate must be re-downloaded at each computer. More 
particularly, when the ob:ect arrives at each a destination 
computer, the object downloads any code which is required but 
not present on the local filesystem, even if that code was 
downloaded at the previous destination computer. Previously 
downloaded code is not cached. Network overhead is incurred 
as a consequence . 

In a "push" model the code for an executing object is 
carried with the mobile object. Prior to launching the 
mobile object, all of the code that will be needed by the 
object is identified. The code is packaged with the agent 
and pushed around the network to each destination computer. 
While the push model reduces network requests in comparison 
with the pull model, network overhead is still incurred 
because of the relatively large amount of code that is pushed 
to every destination computer. In some cases the object will 
push code for classes that are no longer needed. For 
example, an agent may create an instance of a particular 
class of object only in very exceptional circumstances. In 
such a case it is inefficient for the object to push the code 
for this class. 

Another limitation of known mobile objects is difficulty 
in examining and predicting destination information. Known 
mobile objects initiate travel by performing a subroutine 
call. The method is sometimes given a name such as "go" or 
"moveTo," and the' caller is responsible for specifying a name 
or Uniform Resource Locator ("URL") indicating the 
destination computer for the mobile object. When the travel 
method is called, the execution of the mobile object is 
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halted and the mobile object is converted into a network 
transmittable form. On the destination computer the mobile 
object is restored from the network form and restarted. This 
restart can either occur on the instruction directly 
following the call to the travel method, or at the beginning 
of some known method. 



BRIEF SUMMARY OF THE INVENTION 
In order to provide efficient mobility of code for a 
mobile agent object ("agent"), a "mobile codebase" object is 
constructed. The mobile codebase travels with the agent and 
serves as a repository of code for classes that facilitate 
agent operation. When the agent is launched, the launcher 
specifies a list of related classes. These classes are 
retained in the mobile codebase. The launcher also specifies 
a Uniform Resource Locator .("URL") that points to a network 
source ("home codebase") from which code can be downloaded. 
If the agent is required to instantiate an object comprising 
code that is not in the mobile codebase, a network request 
is sent to the home codebase to retrieve that code. Code 
chat is downloaded in this manner is retained m the mobile 
codebase. 

The combination of the mobile codebase and home codebase 
improve agent operation and reduce network overhead. In a 
preferred embodiment an agent is launched with a mobile 
codebase that is preloaded with classes which are certain to 
be needed. Classes that are unlikely to be needed are stored 
in the home codebase. Thus the agent with mobile codebase 
and home codebase provide the desirable features of the push 
and pull models without the undesirable network overhead 
incurred by transmitting unneeded classes around the network 
or re -downloading code. 

Agent travels are defined by an itinerary data 
structure. The itinerary is composed of a list of 
destinations, each of which includes: (1) the hostname of a 
destination computer on the network to which the agent should 
travel, and (2) the name of a method that the agent should 
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execute when the agent arrives at the destination computer. 
An agent is allowed to modify its itinerary. When an agent 
modifies its itinerary, the agent owner is automatically 
notified, thus allowing the owner to "follow" the agent 
wherever it may travel. 

The itinerary provides advantages related to agent and 
network management. Inspection of the agent itinerary 
reveals where the agent has travelled and where the agent may 
travel in the future. Since the itinerary is a standard data 
structure, an observer can depend on it to be present. 
Further, since the itinerary is a separate data structure 
from the agent, the observer does not need special knowledge 
of the internal structure of the agent in order to examine 
the itinerary. 



BRIEF DESCRIPTION OF THE DRAWING 
The invention will be more fully understood from the 

following Detailed Description of the Invention, in 

conjunction with the Drawing, of which: 

Fig. 1 is a block diagram which illustrates agent 

migration; 

Fig. 2 is a block diagram which illustrates agent 
execution in conjunction with agent migration; 
Fig. 3 is a block diagram of an agent; 

Fig. 4 is a block diagram of agent interaction with 
agent managers on multiple computers in a network; 

Fig. 5 is a flow chart which illustrates agent mobility; 

Fig. 6 is a block diagram which illustrates agent 
operation according to an itinerary; 

Fig. 7 is a block diagram which illustrates the agent 
runtime environment; and 

Fig. 8 is a flow chart which illustrates agent 

deserialization. 



DETAILED DESCRIPTION OF THE INVENTION 
Referring to Fig. 1, an agent 10 comprises a mobile 
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object which can travel from a first computer 12 to a second 
computer 14 in a computer network 16. The agent is generated 
and stored in memory on the first computer for a specific 
purpose, and includes both data and executable code. The 
agent executes on the first computer and then migrates to the 
second computer by being transmitted across the network. The 
agent then resumes execution on the second computer. When 
the agent completes execution on the second computer, the 
agent acts in accordance with an agent itinerary. For 
example, the agent will migrate to another computer if the 
itinerary so indicates. 

Referring now to Figs. 1 and 2, the agent executes a 
sequence of instructions during operation. In particular, 
a first method 18 is executed on the first computer 12 and 
a second method 20 is executed on the second computer 14. 
As a result, migration between computers is transparent from 
the perspective of the agent. 

Referring to Fig. 4, agent mobility is preferably 
facilitated through use of JAVA agent manager Objects 32 and 
an Object Serialization facility (a product of Sun 
Microsystems which is known in the art) . Object 
Serialization operates to serialize objects such that a 
representative stream of bytes, i.e., data, is generated 
therefrom. Object Serialization facilitates transmission of 
an agent across the network by serializing the agent 10 into 
a format that is suitable for network transmission. 
Serialization of the agent may also include serialization of 
sub-objects which are contained within member variables of 
the agent. In accordance with the present invention, the 
serialization process involves the serialization of 
executable code, data, and an itinerary as hereinafter 
discussed in greater detail. Once the agent has been 
serialized, a communication socket to the second computer is 
opened and the resulting stream of bytes is transmitted to 
the second computer along the socket. 

The serialized agent is regenerated in the second 
computer 14 upon arrival. In particular, the stream of bytes 
transmitted along the socket is deserialized in the second 
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computer. Deserialization regenerates the agent in the form 
in which the agent existed prior to migration, i.e., an 
object. Following deserialization, the agent executes a 
predetermined method specified by its itinerary. The 
predetermined method may prompt interaction with another 
object 34 located on the second computer. When the method 
has been executed, the agent is serialized and transmitted 
co yet another computer, or possibly back to the first 
computer. The agent is therein deserialized upon arrival and 
proceeds to execute another predetermined method and interact 
with that computer. In the case of the agent migrating back 
to the first computer, such interaction could be with a host 
applicacion 36 through which an information query was 
entered. The agent continues migrating across the network 
in this manner as execution requires. Eventually, the agent 
is terminated when execution of the itinerary is complete. 
It should be noted that the agent need not necessarily 
migrate to the initial host (first) computer after executing 
on a remote (second) computer. The agent could travel to 
multiple computers, and may not return to the initial host 
computer . 

Referring to Fig. 3, each agent may include data 22, 
code 24, sub-objects 26 and an itinerary 28. The data 
portion 22 includes internal state information associated 
with the agent. The code portion 24 includes executable code 
associated with operation of the agent. The itinerary 
portion 28 specifies destinations for the agent. Sub-objects 
26 include code of distinct objects contained within the 
agent. The agent carries the code for these sub-objects. 

The code 24 portion of the agent 10 includes a mobile 
codebase and a reference pointer to a home codebase. The 
mobile codebase comprises executable code which is retained 
as part of the agent. When the agent migrates, the mobile 
codebase is transmitted along with the data, sub-objects and 
itinerary to the destination. The home codebase is 
executable code which resides on the computer which 
originally created and launched the agent or a suitable 
network server (such as a web server) . The reference pointer 
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to the home codebase is a Uniform Resource Locator ("URL") 
that allows remote access to the home codebase from other 
computers in the network. If the agent requires code that 
is not present in the mobile codebase during execution, the 
agent retrieves the required code from the home codebase and 
retains such retrieved code in the mobile codebase. 

Referring to Figs. 3 and 6, the itinerary 28 is a data 
structure which defines agent migration parameters. The 
itinerary is composed of a list of destinations and the name 
of a method associated with each such destination. In a 
preferred embodiment, each destination entry contains the 
Transmission Control Protocol/Internet Protocol ("TCP/IP") 
host name of a computer on the network to which the agent is 
designated to migrate. The method associated with the 
respective destination is invoked upon arrival at that 
destination. Hence, each destination represents a location 
and a task to be performed at the location. 

Figs. 4 and 5 illustrate agent mobility. When the 
determination is made that the agent should migrate, the 
agent manager 30 examines the itinerary 28 to ascertain the 
next destination to which the agent 10 is designated to 
migrate. The agent manager 30 establishes a network 
connection to the agent manager 32 at the destination 
computer 14. The agent manager 30 passes the agent and 
related travel information to the destination agent manager 
32. The agent manager 30 then deletes the local copy of the 
agent, terminates any execution threads which were being used 
by the agent, and performs other appropriate clean up 
activities . 

From the perspective of the destination computer, the 
agent arrives at the destination computer as illustrated in 
step 33. As previously described, the agent arrives in the 
form of data which includes the code, sub-objects, itinerary 
and other data. Java/Object Serialization assists the de- 
serialization and reconstruction of the agent as depicted in 
step 40. The server then spawns a new thread in which the 
agent will execute as shown in step 42. A persistent local 
copy of the agent is then made as illustrated in step 44. 
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As depicted in step 4 6 the agent manager invokes the proper 
method of the agent for execution in the spawned thread at 
this node. The itinerary contains information indicating 
which method should be invoked at each designated destination 
computer. The agent then executes as illustrated in step 50. 

When the agent has completed execution of the indicated 
method, another persistent copy of the agent is stored on the 
local disk as depicted in step 52 in order to prevent 
redundant execution in the event that the computer 
malfunctions before the agent migrates. The agent manager 
then examines the agent itinerary as illustrated in decision 
step 54. If the itinerary does not indicate any further 
destinations then agent execution is deemed complete as shown 
in step 56. However, if the itinerary indicates further 
destinations, then the agent manager determines whether the 
next destination is associated with another computer in 
decision step 58. If the next destination is not another 
computer, flow returns to step 44, thereby bypassing network 
traffic. However, if the next destination is associated with 
a different agent manager then a network connection to the 
indicated agent manager is established as depicted in step 
60. The destination contains a string which indicates where 
to travel. The string contains either the name (host name) 
cf a computer or a URL to a distributed object. The agent 
is then serialized as illustrated in Step 62 and subsequently 
transmitted to the next agent manager as depicted in Step 64. 

Migration in accordance with the itinerary 28 is further 
illustrated in Fig. 6. The itinerary includes a listing 
including identification of each agent manager 66 to which 
the agent is configured to migrate and identification of a 
method 68 to execute at each respective agent manager. The 
agent migrates through the agent managers listed in the 
itinerary sequentially in the order in which the servers are 
listed, invoking each respective method upon arrival. Such 
method could be, for example, querying or updating a database 
on the destination computer. 

Fig. 7 illustrates the agent runtime environment. Each 
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computer 70 on the network includes a Java Virtual Machine 
72 running therein. A agent manager 74 runs on each 
respective Virtual Machine 72. The agent manager includes 
a plurality of threads 76, each thread having an agent 78 
associated therewith. In particular, a new thread is formed 
when a new agent arrives at the server, and the agent 
executes on that thread. Security mechanisms prevent each 
agent from operating outside the scope of the associated 
thread. When agent execution completes, the agent migrates 
to the next destination identified in the itinerary. 

In order for migration and execution to function 
properly, the agent manager modifies the mechanism by which 
Java loads classes. The Java standard library provides an 
object called a "ClassLoader" which can be subclassed by a 
programmer to modify the rules that Java follows to load 
classes. The ClassLoader class allows web browsers to 
download "applets" from a web server. The agent manager 
provides a specialized ClassLoader which allows the 
executable code for mobile agents to travel with the agent. 

During a typical execution of a Java program, a Java 
interpreter loads classes as needed for execution from a 
logical file system on the local computer. However, agents 
become separated from the home computer and the home codebase 
during migration, i.e., agents are separated from the 
directory or directories cn the filesystem of the home 
computer where the code is stored. Further, sub-objects 
sometimes need to be created as the agent executes, either 
as member variables or as temporary variables within the 
methods. These sub-objects could be instances of classes 
which are part of the standard Java packages or they could 
be instances of new classes written by the programmer of the 
agent. However, since the agent is executing on a different 
computer than the home computer following migration, the Java 
virtual machine may not be able to directly retrieve the code 
for the particular sub-object. To allow agents to properly 
load classes and construct objects when remote from the home 
computer, a special ClassLoader is employed by the agent 
anager whenever an agent attempts to construct an object. 
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The ClassLoader object first attempts to locate a class on 
the local file system of the computer. If the class is not 
on the local file system, the ClassLoader searches the mobile 
codebase. If such attempt fails, the ClassLoader sends a 
request back to the home machine of the agent. The agent's 
travel information contains a reference such as a URL which 
refers back to the home codebase on the home computer, and 
by accessing the URL the ClassLoader can retrieve classes 
from the home computer. 

Agent deserialization is illustrated in Fig. 8. As 
depicted in step 80 the serialized agent arrives as a stream 
of data. Java Development Kit Object Serialization classes 
then call an agent manager related method to perform 
deserialization as shown in step 82. The method reads agent 
related objects from the object stream as depicted in step 
84. In particular, the mobile codebase, itinerary and 
codebase URL are read by the method. A custom Classioader 
and Obj ect InputStream are constructed as shown in step 86. 
Object Serialization then reads the agent and other objects 
from the input stream as depicted in step 88 and step 90, 
respectively. When the related objects are read, the 
ClassLoader retrieves the classes which comprise the agent 
as illustrated in step 92. 

The new object's class is loaded once the classes are 
retrieved. As depicted in step 94, if the class is 
determined to have been previously loaded then the previously 
loaded class instance is employed (step 96) and the object 
is instantiated using the loaded class object as shown in 
step 98. However, if the class has not been previously 
loaded as determined in inquiry step 94, then inquiry is made 
as to whether the class is on the local class path of the 
destination computer as illustrated in decision step 100. 
If the class is present on the local machine then the class 
is loaded therefrom as shown in step 102 and the object is 
instantiated using the loaded class object as depicted in 
step 98. However, if the class is not found on a local class 
pach as shown in step 100 then an inquiry is made as to 
whether the class is in the mobile codebase as shown in step 
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104. If the class is located in the mobile codebase then the 
class is loaded therefrom as shown in step 106 and the object 
is instantiated using the loaded class object as shown in 
step 98. However, if the class is not located in the mobile 
codebase in decision step 104 then the class is loaded by 
accessing the home codebase as shown in step 108. If the 
codebase pointer is an Internet type pointer such as a Hyper- 
Text Transfer Protocol ("HTTP") URL , as determined in inquiry- 
step 110, then an HTTP request is sent to the local web 
server as shown in step 112 and the retrieved class is added 
to the Mobile CodeBase as depicted in step 114. However, if 
the codebase URL is not; a HTTP URL then a remote method 
request is sent to a RemoteClassLoader object as shown in 
step 116 and the class is added to the mobile codebase as' 
shown in step 114. In either case, the object is 
instantiated using the loaded class object as shown in step 
98. If more objects exist in the stream to be retrieved, as 
determined in decision step 118, then another object is read 
from the input stream as illustrated in step 90. If there 
are no more objects to be retrieved, flow terminates. 

Having described the preferred embodiments of the 
invention, other embodiments which incorporate concepts of 
the invention will now become apparent to one of skill in the 
art. Therefore, the invention should not be viewed as 
limited to the disclosed embodiments but rather should be 
viewed as limited only by the spirit and scope of the 
appended claims. 

A program listing follows in the attached APPENDIX. 
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collaborate with a specific Agent regarding a certain subject is not known a priori, but is. 
rather, determined as a result of ihc Agent's compulations.) 

Both die interaction between these Agents and the context in which they execute must be 
1'ormaily specified. Standardization has not yet been achieved for these objectives. 
However, the prevalent means lor accomplishing these results is via implementing a user 
model and specifying queries and assertions by using a knowledge representation 
language, the most popular of which is currently Knowledge Query Manipulation 
Language (KQML), and by developing Ontologies, or vocabularies of common terms to 
be utilized by interacting Agents. KQML is comprised of both a language, with a syntax 
unlike procedural or object-oriented languages, and a communications protocol. An 
Ontology is defined as "an explicit specification of a conceptualization". The syntax and 
semantics of an Ontology are generally extensions of a first-order predicate calculus, 
typically the Knowledge Interlace format (KIP). 

The combination of KQML. Kli". and Ontology development is a complex lask. Some 
implementations utilizing these mechanisms arc being developed in the Artificial 
Intelligence community. But this approach has not caught on in other software 
applications. 

In contrast to Intelligent Agents. Mobile Agents are usually explicitly programmed to 
accomplish a specific task. As an example, a Mobile Agent could migrate to travel 
agencies on the World Wide Web and determine the lowest cost air fare between two 
cities. In this case, there is no need for learned behavior or complex reasoning. 

However, the amount of information accessible on distributed systems, including 
databases, the Internet and Intranets, is growing at a staggering pace and much of it is 
available in incompatible storage formats. The need to filter information and make 
decisions based on its content is increasing, and with it. the need for increased 
collaboration among Mobile Agents. 

The need for collaboration is illustrated by extending the above travel agency example. A 
Mobile Agent may need to clone itself and instruct each of its counterparts to migrate to a 
different travel agency site to obtain the best package for a trip to one or more ski resorts 
meeting certain parameters, including air fare, lodging, me;*!. 1 ;, lilt tickets, and car rental 
Furthci more, the information may, itself, be sioted in different formats (databases, etc.). 
necessitating some amount of filtering and data reformatting. Once the Agents have 
obtained their information, they need to collaborate with each other to correlate their 
results and determine the best package, available at each resort for different iravel dales 
and the overall best deal. 

Mobile Agcits are evolving u ; include ii«-.ie»i.»ed iuiellijeiiCv and coliaboiation. Some 
research organizations have begun incorporating KQML and Ontologies into Mobile 
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Agent implementations, while other utilize different knowledge representation languages 
to implement Agent communication. Still. o:'icrs use proprietary object languages. 

3. Problems with Prior Art 

The KQML/Onlology mechanism and other knowledge representation languages are iil- 
suited for general -purpose soitware applications. They require programmers to learn 
multiple languages to formally specify communications and to develop complex 
dictionaries of terms a task thai is currently ill -defined. The knowledge representation 
languages are also extremely unlike the procedural and object-oriented languages utilized 
in building business and general-purpose software applications. 

The need to support asynchronous collaboration adds significant complexity to Agent 
systems implemented via knowledge representation languages (e.g. KQML) and 
Ontologies. Furthermore, there exists a class of Mobile Agents which solely require 
synchronous collaboi ation. e.g.. the travel agency application described above. This type 
of Agent application essentially subdivides a larger task into smaller pieces and creates 
Agents to migrate throughout the network to accomplish it. For these Agents, tiiere is no 
benefit in die added complexity of coding in multiple languages and developing 
Ontologies, nor in the support for asynchronous communication. A synchronous 
collaboration framework in the Agent's language is the best means lor these Agents to 
coordinate their results and implement adaptive behavior. 

4. Some Details of the Invention 

The dynamic synchronous collaboration framework utili/es a distributed synchronization 
point plus object-oriented abstractions to provide synchronous collaboration for Mobile 
Agents in a distributed system. The Iramewoik simplifies collaboration for applications 
which subdivide a complex problem into several pieces and farm out the work to multiple 
Mobile Agents. 

This framework enables Mobile Agents within an application to perform synchronous 
collaboration with one or more affiliated Agents in the application': native language. This 
is accomplished via [hcA^cn; Gran// abstraction. Agents wishing to collubuiaic with each 
other must belong to one (or more.) of the same Agent Groups. The fundamental principle 
behind Agent Group collaboration is that Mobile Agents performing sub-computations, 
possibly on different nodes in a distributed system, will need to periodically correlate their 
results, and potentially adapt their behavior based on the results of the correlation. The 
Ageni Gmup acts as a distributed .synchronization point int iliis iypc of svuchiom »us 
collaboration. 
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1. Introduction 

This document serves as a patent disclosure on the invention enlit!edZ)v/;<7//^t , 
Synchronous Collaboration Framework for Mobile Agents. This document includes a 
discussion of: prior art. problems with prior art. details of the invention, and improvements 
of this invention over prior art. 

Z Prior Art 

"Agent" is one of the most overused terms in the soli ware indusu/y today. Although the 
term may be tised in a wide variety of contexts, software Agents can be classified into two 
major categories: Intelligent Agents and Mobile Agents. Although the two differ in scope 
and capabilities, both types of Agents are able to perform work asynchronously and 
autonomously on behalf of their owners. Intelligent Agents are endowed with some 
degree of reasoning and learned behavior and may make decisions on behalf of their 
owners. These Agents are generally stationary and execute on a single system. Mobile 
Agents, on the other hand, may be transported across nodes in a network, performing 
computations as they migrate. 

The original concept for Agents stems Irom the Artificial Intelligence community. The 
behavior of intelligent Agents may he determined by programming or by decisions made 
by lite Agents on behalf of their owners. As an example, an Intelligent Agent may search 
a database for unusual outdoor scenery, making its own i ions as io whether or not 
each scene meets the specified criteria. 

Intelligent Agents generally employ both synchronous and asynchronous modes of 
communication. Agent communical ion may take the form of queries or collaborative 
compulations. In the realm of Agent computing collahoi aOou may be delincd as "the 
coordination of the compulations of multiple Agents u> achieve a desired result" (e.g.. to 
solve a complex problem). Collaboration often resulLs from discovery (i.e. the need to 
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The dynamic nature of ihc Agent Group enables Agents to join and leave the group at 
will. Hence no a priori knowledge ol the actual Agents comprising a group is required 
and group membership may change over time. 

A distributed name space maintains a reference to each Agent Group. Hence. Agent 
Groups may he located via their entry the name space. When an Agent Group ;s created, 
it is automatically added to the name space. 

The Agent Group's primary responsibility is to facilitate synchronous collaboration for 
Mobile Agents. I lowcver. it also serves as a central point for distributing asynchronous 
events to Agents in the group. A typical event may he the termination of a particular 
Agent. As a side effect. Ihe Agent Group also tracks the travels of its constituent Auents 
throughout the network. 

The travel agency example illustrates the I unction of Agent Groups. The problem to be 
solved can he stated as loliows: A user wishes to deiennine the best package lor a trip to 
a ski resort. The Agents must determine the best travel date ami lime (e.g. anv week in 
February starling on a Saturday, and Hying before noon) and lodging must meet certain 
criteria (e.g.. a two-bedroom condominium) . The trip includes all expenses (e.g.. air fare, 
lodging, meals, transportation, and lift tickets). The user may also specify several possible 
travel destinations. 

This application is composed ol multiple Agents -- each is responsible for querving one or 
more data sources fin perhaps different formats) for specific information (e.g.. searching a 
particular travel agency's database of promotional trips to determine if anv meet the 
criteria specified by the user.) Some Agents may query legacy database systems, whereas 
others may search ODBC compliant databases. (The actual mechanisms lor handling 
different data sources is beyond the scope of this invention. ) 

Before the Agents are transported throughout the network they join a new Atient Group. 
The Agent Group tracks its Agents' travels throughout the network. At any point, an 
Agent may be in one of several states. Figure 1 depicts three Agents in an Agent Group 
performing computations and one Agent in-transit between nodes. 

At dilTeiem point:, dining then i nigral ion. Aycnus may wish in »ouclalo then icsuUs. and 
potentially change their migration plans or behavior. Suppose each Agent migrates to a 
local travel agency. Ueloie migrating to travel agencies in different cities, the Agents may 
wish to con elate their results and potentially adjust their behavior. Suppose one of the 
Agents dc:ermines that a particular ski icsort. say Tao.s. has no iwn-hodroom 
condominiums available during February The Agents in the group mav wish in (.hop ai! 
further queries about trips to Taos. 

Agent Group collaboration is implemented via a distributed synchronization point (also 
known as a collaboration point) and a software routine to analyze the results of each 
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Agent s computation. The Agent Group abstraction provides the distributed 
synchronization point. Fach application need only provide its own software method to 
analyze the results and potentially allow each Agent to adapt its behavior. 

The distributed synchronization scheme requires that each Agent arrive at the 
collaboration point before collaboration may commence. Hence, it is best suited to 
applications that subdivide a complex problem into many sub-tasks thai need to correlate 
their results. As each Agent arrives at the collaboration point, it posts the results of its 
compulations to the Agent Group, and blocks until all the other Agents in the group 
arrive. Figure 2 depicts one Agent in the group waiting to collaborate while three others 
are still performing computations. 

The Agent Group collects the results of each Agent's sub-computation. When all Agents 
have arrived at the collaboration point, as shown in Figure 3. the Agent Group notifies 
them thai collaboration may commence. When it unblocks (he waiting Agents, the Agent 
Group passes the collected tesults to each Agent. Each Agent then calls the appiicaiion- 
specilic method to analyze the results ami potentially adapt its behavior. Figure 4 shows 
thai all Agents have arrived at the collaboration point and are now in the analysis stage. 

The synchronous collaboration framework supports both parallel and serialized 
collaboration analysis. Figure 4 depicts a parallel analysis implementation; Figure 5 
illustrates a serialized collaboration analysis, in which one Agent is in the Analysis state, 
while the rest remain waiting in the Collaborate state. 

The distributed collaboration point may be implemented via an object transport or by an 
RFC mechanism. It may also be implemented in any procedural or object-oriented 
language. Object-oriented languages simplify die implementation, as the application need 
only subclass the Agent Group abslraction and provide a concrete method to analyze the 
results and potentially adapt the Agent's future behavior. 

The Agent Group ensures that all Agents in the group arrive at the synchronization point 
by tracking the Agent's migration through the network. In the current implementation, as 
part of a mobile Agent system, a server (known as the Conduit Server) on each node 
manages the Agent's migration and informs each of us Ag<mi Groups when the Agent 
arrives and departs. Should an Agent fail to arrive at a collaboration point in a pre- 
determined, configurable length of lime, the Agent Gmup will "ping" the Agent by 
sending a message to ensure that it is still alive, as shown in Figure 6. (In the current 
implementation, this is performed via the Conduit Server on the node where the Agent is 
executing. ) If the Agent fails to respond to the ping, the Agent Group notifies the other 
members of the group by distributing a Collaboration Failed asynchronous event to diem 
thai indicates dial a particular Agent ks not ie.\pondi:ig. The Agents may then indicate 
whether or not they wish to proceed with the collaboration. Figure 7 depicts the Agent 
Group's distribution of a Collaboration Failed event followed by the remaining Agents 
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indicating that they wish It) continue the collaboration. Alternatively, the Agents could 
decide to abort the collaboration. 

The Agent Group also implements deadlock detection by means of the time-out 
mechanism and Agent ping described above. The ping actually returns the stale ol' the 
Agent in question (via the Conduit Server). II' the Agent is already in the Collaborate slate 
but has not arrived at this collaboration point, a deadlock has occurred. This is shown in 
Figure 8. In this case, the Agent Group will abort the collaboration and notify the Agents 
in the group of the deadlock by sending them a Deadlock Fvcni. as shown in Figure L ). 
Note that since Agent Group collaboration is designed for closely coordinated Agents, the 
existence of a deadlock is generally a result of a programming error. Hence, the Agent 
Group does not need to employ a more sophisticated scheme for deadlock detection or 
avoidance. 

Agent Groups provide reliability by saving the state of each Agent in the group to 
persistent storage. If the Agent Group should terminate unexpectedly, it is restarted and 
reads the state of the group members from persistent storage. The Agent Group's restart 
is transparent to the Agents. They actually communicate with an Agent Group Proxy 
(instead of an Agent Group), which shields them from Agent Group failures. 

Figure I I illustrates the flow of a typical collaborating Mobile Agent. Ilach A sent creates 
an Agent Group Proxy lor each Agent group it wishes to join. The proxy's primary 
responsibility is to maintain an active connection to its associated Agent Group and to re- 
establish the connection or re-create the Agent Group, as needed, during Agent Group 
failures. 

When the Agent Group Proxy is initialized, it establishes a connection with the appropriate 
Agent Group. It first attempts to find a reference to it in the name space. If this fails, it 
creates the Agent Group and enters a reference to it into the name space. The algorithm 
guarantees the atomicity of this operation. 

After the proxy has created the Agent Group or established a connection to it. the Agent 
continues its computations and migrations. Eventually, it mav attempt to collaborate its 
results. This is accomplished by means of the A«:ent Groun Proxy. If the A«ent Group 
has failed or is in a unknown state, the proxy will be unable to contact it. !f this occurs, 
the Agent Group Proxy retries the communication. If. at this point, the proxy is still 
unable to communicate with the Agent Group, it recreates it and updates ihe name space 
with a reference to the new Agent Group. The re-creation of the Agent Group is serialized 
to prevent multiple Agent Group Proxies from simultaneously doing so. If a proxy 
determines that the Agent Gioup r, in the process of being re -created, it simply waits until 
it can find a relerence to the new group in die name spate. \;:ice the Agent Gump has 
been re-created, ilie proxy retries the collaboration. 
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As mentioned earlier. Agent Groups provide a distributed events mechanism in addition to 
the synchronous collaboration framework. The distributed events mechanism enables the 
Agent Group to notify members of t ho group of outstanding events, such as the 
termination of an Agent, or ihe detection of a collaboration deadlock. Agents may build 
on this mechanism to lorward application-generated events to other members in the group 
Hence, if an Agent catches an application-generated exception it may notify the other 
Agents in the group before terminating. Figure 10 illustrates how the Agenl Group 
forwards an lixception livent. generated by one of its Agents, to the rest to the group. 

Currently, the Agent Group bandies distributed events by maintaining a {possibly remote) 
reference to an event queue associated with each Agent. The Agenl Group forwards ail 
events it receives to the other members of the group by enqueuing it. The Agent Group 
may be implemented without a remote referencing capability, but this would add 
significant complexity. In the cuiretu implementation, each Agent contains an events 
thread which is responsible for dequeuing the event and calling the application-specific 
event handler. (This thread could easily be a process, if threads were not available. ) 

In addition to forwarding events to members of the group, the Agent Group may generate 
its own events and distribute those to the group members. As an example, the Agent 
Group distributes a Dead!<\ k |- vent to the group members when its detects a deadlock 
situation, as illustrated in i'tgure 9. 

As mentioned earlier. Agent Groups track the migrations of their constituent Agents, with 
help from the Conduit Server tin the current implementation). If an Agent is in transit 
when the Agent Group is forwarding events, it queues the events locally, as shown in 
Figure 10. Once the Agenl arrives at us destination, it notifies the Agent Group, via the 
Conduit Server. The Agent Group then flushes the events it stored locally for that Agenl. 

Agent Groups implement varying levels of persistence, as defined by the actual 
configuration. Memberships and Agent slates are updated infrequently, so they are 
generally written to persistent storage. I lowevcr. local queues maintained on behalf of in- 
transit Agents may also be saved in persisient storage, if desired. 

Implementation ol (he Agrnt Group in an objeei oiionird language enables applieaiions in 
extend its functionality, if required, by subclassing the Agent Group object. 

5. Benefits of the Invention 

The work described above: provides several benelits, Ii ereailv simplifies the 
implementation oi synduoiiuus collaborating Mobil.- .'-vms. i-speeiallv foi applications 
that subdivide a complex task into a series of related sub-tasks. There is no need for 
application developers to learn knowledge query representation languages, such as 
KQML, or to develop complex ( )niologies. The dynamic synchronous collaboration 
lramework provides a natural programmatic implementation that may be programmed in a 
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number of languages. An added benefit of this scheme is that collaboration is 
implemented as part of (he application, programmed in the same language as Ik a ol 
,h : application. The current implementation in an object-oriented language (Java k m 
enables the technology to be easily extended so that more complex miell.gei.ee schemes 

may be supported. 

A,cnt Groups facilitate Mobile Agent tracking and may also be queried by tools that 
monitor Agents. In addition, collaboration may be performed through discovery, as w„h 
many knowledge representation languages. 

A-cu Groups also offer reliability by providing persistent Agent Group membership and 
A; state ntor.na.ion. Furthermore. Agent Group Proxies shield Agents Irom the 
effects of Atc.it Group failures. They detect an Agent Group s la.lure and automatically 
restart the failed Aaeni Group (which then restores the state of its membership Irom 
persistent storace) and retry the current operation (e.g.. collaboration). The algorithm 
also guarantees the atomicity of Agent Group creation and re-creation. 

An Aocni Group also detects Agent failures and deadlocks and forwards this information 
l0 the mher members of .he group via its distributed events mechams.n. lurilicnnore. this 
mechanism allows Mobile Agents to asynchronously no.it y associated Agents ot relevant 
events, such as the catching of an exception. 

implementation of Atient Groups in an object-oriented language also enables additional 
application-specific functionality to be easily added via inheritance and polymorphism. 
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Design Specification for Java Agent 
Coordination 

Version 0.2 1 
1. Introduction 

Java agents have the capability ol coordinating; (heir activities This coordination lakes two 
mam loim.v synchronized collaiKiratum ami asynchronous notifications These modes ol ( 
communication complement each oilier ami their implementations aic related. 

Collaboration 

The eollahoralion paradigm is implemented as follow> 

• multiple auents perform computations at different tunics in the network. 

• alter performing alt or a subset ol their operations, auents wait ai a distributed 
synchronization point until all agents have 'arrived 

• auents coordinate by potentially serialized execution of a synchioni/cd method. 

Coordination can take the lorin ol performing compulations on intennediate results and/or 
updating agent itineraries. 

Notification 

The notification scheme uses a distributed events mechanism to communicate agent state 
changes that occur asynchronously. It is mamlv uuli/cd tor distributed exception handling 
but may also be used to notify related agents ot events, such as another's termination. 

As described above, agent coordination utilizes distributed synchronization and event 
handhmJ. However, Java possesses neither of these. Aciually. us synchronization primitives 
an- limited to cmicnl scciu»ns on a single system and a notification scheme that can only 
handle a single t>pe ol event. Hence, a great deal ot the complexity m the task of agent 
coordination is comprised of implementing mechanisms to overcome Java's unsuitability lor 
distributed processing. These mechanisms are described in the remainder ol this document, 
nlonti with the new objects that implement them 



1 Revision ihsioiy 

07/26/% Version 0. 1 Initial revision. 

1 1/1 2/% Version 0.2 Maior changes io Notilkiiiions ami inceptions and Collaboration sections 
ret led actual unplcnienuitnm. Removed I • veins sec lion 
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2. 



Synchronization 



As mentioned nl>ovc\ agent cooidmatiou requires distributed synchronization mechanisms, 
such as locks and events. Since Java docs not provide any distributed locking, we are laced 
with the following choice; 

1 Utilize a centralized locking scheme. 

2. Develop our own distributed locking paradigms 

.V Use Java's native methods to lnteitace with the operating system's synchronization 



The latter choice is unacceptable treatise it compromises ihe portability ol our agent 
infrastructure, whereas the first option may potentially introduce considerable network 
overhead. The second alternative also requires significant development elTon even to 
implement a well-known solution to the problem 

In the interest ot expediency 'as required by the tightness ot our schedule), die initial Java 
agent mtrasuueture utilizes KMI to implement a centralized locking scheme. Lock in a is 
implemented via met'iod invocations on a potentially remote object (culled an A^emOmttp. 
See Section } tor details I Agent coordination is implemented by (remote) invocations on a 
method winch requires synchioiu/eil access. (See Section ,V> 



Agents that may wish to collal>oraie their results subclass Culluhoraun Avctit , an abstract 
clabs derived troin Aqeiu ( ollahoraiorAgcm contains a iiiinuuum ol two threads - one to 
perform compulation and to travel and another to handle asynchronous event notifications. 
Applications that contain colla!>oraiing agents suhclavs ( 'olIahoraiorAgcm and. ot course, 
these derived classes may implement several computation threads 

P.ach collaborating agent belongs to one or mote agent groups, which are dcscnlxal hy Agent 
(iioup ohtecis. Agent (houp is actually a distributed KMI oh|ect A^cminoup defines the 
unci lace. AventCrtvuplmpt, an abstract base class derived Irom l\'rsisicnil\\'nnlUruuplmpi t 
provides the implementation (See Design Spcctticti:.i>n j.>r Ihunbuwd Java l:\cnts lor a 
description ol IVrsislcuiLveiitC irouplniplj 

An AeentGroup is essentially a unit ot coordination Hence agents may couidiuau: with all 
liic oihei agents in an A^>.nt( h imp They may a No create new Agrutf iroups on demand, aiul 
join and leave groups at will (In practice, AgeniGroup must he sul>classcd tit uuplemcni 
agent collal>otaiiou. 1 lowever, this document d<x\s not distinguish between the base class and 
its derived classes and refers to them collectively as AgcnK iroups ) 

An A::enU iioup is an object tlial in essentially sha:t:d among the incintvrs o! an ageait 
coordination gioup. U is owned b> the Agent thai initially cicatc* the gmup (an agent group 
is created by instantiating Agcnl( iroup) and accessed via a potentially remote UMI rclercnce. 

Ihe relatumslnp IxMwccn L'ollalxiraiorAgent and AgeniGroup is similar to that ol Thread 
and IhreadC iroup A ThrcadGroup tnaiuiains ivieieuccs to the Threads composing the 
tiroup; an AgeniGroup maintains a similar list of its ( 'ollaboramrAgents. Both 
ThrcadCiioups and AgcntGroups form a hierarchy and each contains a reference to us p;u*enl 
group. Thread's constructors are either passed a rclercnce to a I hreadC iroup or they save a 



primitives. 



3. 



CollaboratorAgent and AgentGroup 
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reference to the parent's Thread's iiroup. Likewise. CollaboratorAiicnt's constructors may he 
p;isscd one or more AeenK iroups or save a reference to Atienidroup of its parent, if it exists. 

However, there is one noticeable dHtcrcncc between the two types ol groups. A thread may 
only t>elonij to one Thicad( iroup at a tune, whereas a Collaboratoi Aeem may siinu!iancousl\ 
l>e a member ol several Ai:cnt( imups. which constitute a hierarchy. Hence. Thicads contain 
a reterencc to tlieii a.w>ciaicd lliteadt iroup. hut ( 'ollal>oraiorAt:cnis maintain a Iim u| 
relerences to their Ai:cni( iroups 

Support toi multiple AecnU ti t nips facilitates coordination anions; lelaletl groups of agents 
and also enables the Lieation ol an A<jcnt( iroup luerarchy through which communication 
may l>c propagated. The pilot application may utih/e miiinple a;jcnt groups, as .shown in 
1 itnirc I . 

"['his lteure portrays an example ol two A^enK iroupv Al'ciiK iroup A consists of three 
aiictus - one on each LAN m tiie system, whereas A^enK iioup li contains aeents on multiple 
nodes on LAN 3 A distributed application running on a configuration such as this typically 
creates multiple A:!ent( iroups when it needs to traverse the WAN. In this case. 3 ayents are 
cieaied m Aiientliioup A. one lor each LAN Once they arrive on a node, these auents clone 
themselves, creatuni more aiicuis to t>c distributed across nodes on the LAN (e.i:., 
AiicnK iroup 1U This approacti tniniim/cs network traffic over the WAN and lorms a multi- 
level hierarchy ol Al'cuU iroups Agents in the mira-LAN groups lc.^., AeenKiroup li) can 
communicate their lesuits. which can then l>c coordinated with the inter-LAN a roup tie.. 
AgentC iioup A ) 




Liiiurc I: Multiple AueutC iroups 
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By default, KM I passes all local objects by copy. Mowevei. the above scheme requires that 
each Agent actually maintain < remote) references to tts AgenK iroups. Hence, the agent 
infrastructure overrides some ol UMTs object serialization mcthmls to generate the required 
references. 



Both asynchronous noiificaiion aiul collaboration ate implemented via the associated 
AgenK iroup object I lie following description server as an example of asynchronous 
notification handling via distributed events. (See /k'st-^n Sftrtncatitm jot Dtstubuu ;/ Java 
f -.vents lor more details on event handling ) 

1 An agent catches an exception and wishes to notily the other members ot the ;j:oup 

2 l ite agent posts an A^cntlAccfXhuhAi'tu to the AgenK iroup via the group's ff*j\tl\vcnt 
method The Agent! ■xcepMonhvcnt indicates lite type ot' exception that occurred 

The Al;ciii( iroup posts the Agcutl :.\ceptionl-.veni to the other audits in the gmun 

4 liach agent's Hvcnt llandlei pcitorms application-specific handling H the- 
r.xcepuoiiLivent 

If the agent thai caught the exception wishes lo notify another associated Agent (iroup. ii 
repeats (lie al>ove procedure with the next AgenK iroup object. 

Occasionally. the Agent Cironp may gcnciate events that it directly loi wards lo a uiemlvi ol 
the group (e g., to "ping" it attei n lads to arrive at a collaboration point) or others that il 
"mullicasts" to its members (e g., an Agent's failure to reply to a pmg) 



Agent collaboration is more compiicated than asynchronous notifications It :s iinplcmeiiicd 
xs follows: 

1 An agent perloims some computation and arrives at a swichrotiizatioii point 

2. The agent performs a (remote} invocation ol (he Agent( iroup s aillttbumc method, 
passing u an AnentStaiits object. 

It no collnlxnation is in-progicss (i.e.. this is the fust agent lhai itas tcqiK^lcd 
collaboration), collaborate calls its synchronized bcwnCullubotatc method, which 
initializes the numl>er ot agents to wait for l)c!ore collaboration may Ivgin o e . //-( loi 
an n-agent group ) (Race conditions are handled by checking if the agent count has 
been initialized (i.e . it is uon-/euo Itelon: coniniiting A lace implies lhai iun agents 
aie attempting io initiate the *ninc collaboration Otherwise the application is 
scmnnucally incorrect.) This routine saves the requesting agent's unique ID (obtained 
from ihe Aucm.Stauis object » and starts a collaboration timer (with suli'iciem time for 
agents to arrive across the WAN) by passing a configurable tune -out value to the 
AgenKiroup's wan method. 

T Otherwise (i.e.. if a collaboration is in -pi ogress), collalxirate calls the synchmni/ed 
(tecremetuCnlhihumtv method to add the requesting agent's unique II) lo the hsi ot 



4. 



Notifications and Exceptions 



5. 



Collaboration 
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acents arriving at the collalMirancui point and to decrement the waiting agent cuuntcr. II 
the counter is non-zero, this method bhx'ks with no lime-onl value Otherwise, llie 
Aecnt (iroup awakens t he oilier threads waning Im collahoianon to commence. 

5. If the tuner expiic.s. all agents did not arrive at the collalniraiiou point in tunc. This 
may occur localise an agent receiveti an uucaughl exception ami terminated 
unexpectedly or Ixxausc a deadlock condition exists. {Since agents may belong to 
multiple groups, overlapping collalxnations could result in deadlock. However, a 
properly axled application will not generate dcadltn'ks Ixjcause the collaboration points 
must lx: known a prion and must he executed in the same order among collaborating 
auents. i.e., collaboration must fust hatulled at the leal Agent (iroup and propagated up 
the hierarchy ) II a time-out occurs, llie Agent (iroup thread initialing the collalKiration 
ton behalf oi us associated ( 'oIlaboraiorAgcnu is awakened and performs the following: 

• It eall.s the AgeuK iroup's c/n'ckC'itfbtboran' method which returns the collaboration 
state (either ('(dlalwmtumSuiarded or CollabormiimFaikd. depending on the 
value of the waiting agent count) 

• If the collaboration tailed, llie collalniiaie method calls rccuvcrCulhtburaic This 
method attempts to communicate with the agent.s (hat did not arrive at the 
collaboration point by "pinging" them (It determines these agents by comparing the 
list of arrived agents with the group membership.) The ping is actually periormcd 
via a message to the Conduit Server on the node where each agent was last known 
to be executing. If the agents ate located and any ot them is in the Collaborate state 
and but has not arrived at tins collaUtiaiion point, a collaboration deadlock has 
occurred and the collaboration stale is set to ('(dUdwnmonJkadlock If any of the 
agents cannot lx* located, the collaboration state is set to ( "ullaborationl "ailed. 
Otherwise, it is set to Colltd>ttiuh<ttd<vti\ and the Agent (iroup thread retries the 
collalK>iation up to a configurable niuntxT ot times (alter which the slate will lx: set 
to (.'ollaborationl ailed if the collahoianon still tunes out.) 

• The initiating Agent (itoup thread wakes up the oilier blocked thtcad.s by calling 
nofifvAH on the AgcnK iroup. 

o. Once all the collaborating Agent ( itoup thread* have been awakened, '.either localise the 
counter has dropped to 0 or a (ime-oiit occurred), ihey call (he AgeniC iioup's 
clu'ckCullaboraic meihod. It this method returns a slate other the 
CoIlaboratioriSuccccded. each thread returns the appropriate exception (i.e . either 
CollabonmanFailcdExcepiton *>r CidUd>uri\tumlkadlovklixvcpiwn\ to its invoking 
CotlaboratorAucnt, 

7. If the collalMiration Mate is t 'ullaborationSucceeiled. collalMuatiou commences by 
executing a potentially synchronized application -specific method, analyze Ik suits, to 
perforin the collaboration. analy/eKesults is an abMiact AgcnUironp method that must 
lx* implemented by derived classes to pcrtoim application-specific coHaixiration As a 
te.Mill ol' collah'.ii aiitui, .luviii itmeiai ic.s may be updated 

X. As each thread completes us colial>oration, it replies to the remote collaborate 
invocation, passing any state specified by the implementation, (e.g., updated itineraries). 

( ) The agents then continue execution on their current node and travel as required by their 
itineraries. 
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As dcscrilx;cJ alxive. collaboration requires cumptcx mechanisms. However, mosi of these 
are necessitated by the limited .synchronization primitives provided by Java. 
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Introduction 

This document describes a general -purpose solution u> disliibutcd event management 



2. Overview 

This section provides a ht;:h -level description ol' I he objects tbai implement the distributed 
events hamcwoif. 

2.1. Objects 

Events 

l -vents are dcscrilxaJ by classes thai derive I'rom /.vc//f/Y/v kach hventlypc object 
includes, a unique ID (a String) generated by the constructors ami a description oi the event 
Ui Stnnu) opiioually passed to the constructors. 

Event Handier 

The Evcniliandtcr interlace specifies the iuituKcEvcnn i ineilitxl which implements an i {vent 
Handler hach application must piovuie its own l-vent Handler to perform apnlication- 
specinc event management. 

Event Notification 

The Excml'uM i mcrtace specifies the ftostEvvnm iiilmIuhI which implements event 
notification. Several of the classes described below implement tins interlace. 

Event C\ie ! .::; 

Anv object recnvui" ntitilkation ol events iimsi own an i-.ve.ut Oucuc and an associated 
(la ead that ;aan;;:;es lite queue. The iweui Qucuv n cou.siiuci* m is payscd an I .veuti laitdler 
stub. It instantiates an Eve hi Que uc'fii raid (a prcieiitu class ilcrived from Thread) to 
iiiaaaue the queue and passes i!ie I -\cnil landlci -Jul/ u> il:» o»nsli actor The 
nveniUueueThread's runi) method removes events from the queue and calls (he 
handlelivcntf ) method 



' Revision llistoiy: 

09/267% Version O.l lniti;»l revision. 

i I /i 2/96 Version 0.2 Kxpiimted discussion ol' Iwein Manner :md I -.vent (imup Added Reliability 
Features and Garbage C'ollcclion sections. 
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Ah Tivcni Queue is a distributed KM1 object. P.vemQucucJmpl implements the liventPost 
interface by appending the specified I -vent Type object to the queue and calling the associated 
KventQuettzThreatr s notifyi) method. 1 mis action wakes up die liventiJucueThrcad (if it was 
blocked). The thread then proceeds lo dequeue cacti pending event and pass it 10 the 
ItandleKveniO method 

Event Manager 

The I -vein Manager handles the legislation, posting, and notification of events When 
objects request notification of specific event types, they must pass the I: vent Manager a 
reference to their HvcutPosl interface. 1 he I -vent Manager saves the reference in a hash table 
that it uses to map event types to their notification requests. When an object posts an event 
(via the I -vent Manager's postl-venii) method), the hvent Manager obtains die list ol objects 
to notify from the hash table and calls each ot their postkvcniO methods. 

The I- vein Manager also maintains a list ol objects (hat have icquested notification of all 
events. Whenever it receives an event, the Iwcnt Manager also lot wards it to these objects, 
by calling each of their pusil-veiuO methods. 

f.veniManagci is an KMI distributed oh|eci. l.vcnlManitvci descrilK:s the interlace, whereas 
Eve nt Manager I mpl provides the implementation. KvcntMauagei defines methods to manage 
event registrations (e g.. add and delete legislations). 

riveiuManagerlmpl also implements the hventl'osi interlace lis posiKvcntO mcilux! is 
passed an event from its originutoi ami notifies the recipients of the event by invoking their 
posiHveutO methods. 

At most one t-veui Manager runs on each iukIc in the Agent system. A reference to M can Ix: 
obtained via the KMI Registry 

Event Group 

A i:roup ot objects interested in a common set ol notifications may form an Hvem Group 
l-vemtiroup is a distributed RM1 object: ilvauGmup defines the interlace. EvvniGrouphnpi 
consists of the implementation. HvcuiGroup defines methods that manage the group (e.g.. 
add and remove members). 

Whereas the l-.vent Manager filters posted events on behalf of us clients, lorwardmg them 
onlv the events they requested, the I -vent Group pertorms no filtering P.vcniGrouplinpl 
impleineuts tlie HvcntPosi interlace However, its postl'.venn I method forwards each event H 
receives to every member ol the group (by calling their postHvcniO methods) 

l;; practice, i*. v ciil wroups should he used sparingly he<:a;is<' they could allnv- an abusive 
application to ycncuite unwanted notifications. The Agent framework does mih/e (his 
mechanism. Inn it veil ties that all events are gcnciatal by a group niemhei and u only 
utilizes the hvcm '.-.roup iVr some well-known events, such as the termination of an Agent. 

l.-.ach l-.vent Group is idcntilicd by a unique name either pa.^cd u< its consu u-.ior o; assigned 
by it. Objects may obtain a handle to a particular l-.vent Gmup by presenting the KMI 
registry with this unique name. 

2.2. Reliability Features 

The Distributed I- vents framework incorporates several reliability features These generally 
take the ioim ol persistent siate and proxy objects. 
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Event Manager 

The Distributed H veins iraincwMk shields objects Iroin the ellects of kvent Manager failures 
in i wo ways: 

• hy saviMU its slate uc. event registrations) to peisistcut stoiagc. nnd 

• hy uncapstilatm;J us Tvinciiouahty in a proxy reject. 

[ he kvent Manager .saves Hie loliuwmg ileitis in tlie pcisistcnt More: 

• i lie hash table mapping specific event type* u» the objects registered to 
receive lliein and 

• the list of obiects to he nonticd ot all events 

Pach time an ohieel cither registers mi "unrcgisicis" lis interest m receiving any tor all) 
events, the Hvem Manner writes the updated event reparations (i e.. either the hash table or 
the list ol ohieets. hut not ImiiIu to persistent storage Ma the Persistent Storage Manager 
These ate Tairlv inliec|iicnt operations, so the petioiinaiiee impact ot this process should be 
nciihuihie. (See Design SnecKtathon Jm Java Avent r't'isntcricc Package for details on the 
Persistent Store Manager < 

Whenever the 1 ■ vcnl Manager is started, iis initialization axle attempts to recover any 
cxistiiiu event registrations Irom persistent stoiagc Hence, registrations are not lost when 
the liveni Manager lads 

In addition, the 1-veiu Manage! Proxy also pi events Oi Meets Iroin experiencing tlie ellects ot 
l:\enl Manager Tailuies It acts as a wiappct ohicci for the I -vein Manager. P.ach Object 
wisiniii! to eominunicaie with the hvem Managei n m^t lust create an LvcritMututycif'nt.w 
obieet. The proxy ohiains a re Terence to the I: vent Manager via the KM I Registry. It, at any 
point, the proxy is unable to communicate with the l:\cni Manager, it will attempt to obtain 
a new reference from the icgisiiy It will reny this operation several times Ivibrc throwing 
an exception. 

Purthcrutoie. d die I -.vent Manage) should tail, it \«.ili .uiiomaticaily iv re-slatted by the Java 
Agent System. 

Persistent Event Group 

Tlie t/'isii ihuied i -vents :t amcwo; u piovuies a gene; al -purpose miplemeuiatioii oi ) -.vcnl 
< iroiips ti e.. I • vrntt iiouni. as desciihcd al.ovc ilowcvn <i also provides a reliable 
implementation of P. vent tiioups i'eisistcui J : vein dioups Pcimmciii I -vein ("iroup is a 
distributed UMI obieci that extends PvcnK iroup the interlace is defined by 
t'ersistenti'.vent(jmui> and the implementation is provided by reitsicntlivcntdtottffhnpl, a 
subclass ol l-.venn iroupiuipl tVi sisirr.t I veni ( iioun taiti/es persistent storage in inueh rlu* 
same manner as the hvem Manager. Whenever an Ohieel joins or leaves (he gioup. tt save:-, 
a reterenee to it in persistent storage. 

Liach Persistent P. vcnl (iroup is also encapsulated in a proxy object: 
PcrsistemliveniGivupl'row. This proxy operates .somewhat differently than the livent 
Manager Proxy, depending on how it is constructed In some cases, it will attempt to locale 
a named Persistent I -vein (Iroup in (he UMI registry If a name is not supplied to the 
constructor, it will create a new Persistent Pvenl Group and register it. 
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Since Kveni Groups ;irc temporary objects, unlike Hie I -.vent Manager, which is a persistent 
server, their proxies cannot expect their asst>ciated Persistent I -vein Groups to be 
automatically re-started upon lailure Hence, a proxy may tc-crcatc ihe ijrnup il it is unable 
lo obtain a reference to i( alter Millictciu ictrics. 

This, however, iniruluccs a lace condition wherein multiple proxy objects may 
simultaneously attempt to ic-cicate the Persistent l:\ent Group. This is handled by the 
following mechanism: 

• It the owner of the Persistent hvent Group detects the lailure. il re-creates 
the group. ( The owner is de lined as ihe pro\> that initially created the 
uroup.) 

• It the owner does not detect the lailure m a ci mityurahlc leneth of time, 
oilier proxies may attempt lo re -create it. 

• Ihe Persistent I vent Group is re-created via (lie lol lowing steps: 

• Attempt to create a temporal y binding m the KM I name space with a 
well-known name derived from the PcisMcnt hvent Group's unique 
name. 

• If the bindiue dt>e^ no\ return an AlrciuhlioimdHwt'plwtu proceed to 
re-create the IV: . lenikveiitGroup and then remove the temporary 
binding (OlhcrwiNC. another proxv is re creating! it So wail for its 
completion.) 

2.3. Garbage Collection 

Holh the 1-vent Manaecr and livcnt Gump ohiecis must Iv prepared to earba^c collect stale 
references. This is simply pciloiincd by deleting anv ohjects (ir . livcnil'osl stubs) that it 
cannot communicate with Hence their postl-.veim ) mcdiods handle iiathaijc collection alter 
notifvm.ii all interested obiects t»t ihe event 

3. Changes to Agent Implementation 

CollaboratorAgent 

Tlie CuliaboratorA^m class contains a relereuce to an event queue (i.e.. an 
Lvcni'vUieuetmpl object), which i> nisianiiateu by us constructors 

The I -.vein Queue docs noi persist across an Agent's tra'.els Hence, its fm-fnuel-orlrunsUi) 
method Hushes the queue and voids tlie Agent s relereuce to the queue before il travels, lis 
associated Agent Gioups save any events thai occur while the Atient is in-transit. The 
i<m\nicU'(iiivnstHf:t\ \ i:k:IIu;.i. vailed attci the .'Wul ;:itm:s at Ms destination, cunsitucts a 
new i-veti!' Jueueluipl whjei.i ami ihi.sht •. a;i\ c/cnu ^..d U\ die associated A«!ciii Groups 
while tlie Agent was in-transit. 

AgentStatus 

The AiiL'HtStatu.s class contains a reference to the PvemPosi interlace implemented by the 
CollaboratorAiieut's l-vent (Jueuc. It also contains an Agent's unii|iie ID and current status. 
Hence, it will serve as both an kvcul Queue and a status indicator. 
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AgenlGrouplmpI 

The AqcntGrottphnpl class derives from PersisientHveniCiroupImpl. Tluis. it not only 
enables Agent collaboration, hut also provides reliable group event handling 

As a result, Agent (lumps may implement diticicnt levels of peisisicnce: (iroup 
membership is always written to persistent storage. Inn queued events lor in -transit agents 
will alsi) he saved it' the Agent (iroup s conligtiration allows it 

Occasionally, the Agent (iroup may generate events that it directly loi wards m :«. member of 
the group (e.g., to "ping" it alter it tails to arrive at a collaboration point! or others that it 
"rnulticasts " to us members (e.g.. an Agent's failure \o reply to a ping) (iroup memlxirs 
may also broadcast an event to the group (e.g.. an Agent may inform the group that it has 
encountered an exceptional condition) 

AgentEvenl 

The A[>etitl:veni class is the superclass of all events generated by Agents It includes the 
Agent's unique ID. 
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CLAIMS 

What is claimed is: 

1. In a computer network including at least a first 
computer and a second computer, an apparatus for performing 
a task in a second computer, comprising: 

a routine that generates a mobile agent object in the 
first computer, the mobile agent including both data and 
executable code; 

a protocol for transmission of the mobile agent from the 
first computer to the second computer, wherein execution of 
the mobile agent in the second computer following such 
transmission prompts the task to be performed in the second 
computer ; and 

an itinerary containing a reference to each destination 
computer to which the mobile agent is designated to migrate 
and a reference to a method associated with each respective 
destination computer reference, the respective method being 
invoked when the mobile agent is present on the respective 
destination computer. 

2. The apparatus of claim 1 wherein the transmission 
protocol includes a routine in the first computer for 
serializing the mobile agent to generate a stream of data 
therefrom. 

3. The apparatus of claim 2 wherein the transmission 
protocol includes a routine in the second computer for 
deserializing the stream of bytes to regenerate the mobile 
agent therefrom. * 

4. The apparatus of claim 1 wherein the task is data 
gathering, and wherein the mobile agent is transmitted back 
to the first computer from the second computer following 
completion of such data gathering. 

5. The apparatus of claim 1 wherein the mobile agent 
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migrates to a plurality of destination computers within the 
computer network. 

6. The apparatus of claim 1 wherein at least one 
5 destination computer reference is a Uniform Resource Locator. 

7. The apparatus of claim 1 wherein at least a portion of 
the executable code required for invoking the method is 
retrieved from a mobile codebase portion of the executable 

10 code included in the mobile agent. 

8. The apparatus of claim 7 wherein the mobile agent 
includes a reference to a home codebase located on the- first 
computer, the reference being employed to retrieve required 

15 executable code which is not present in the mobile codebase. 

9. The apparatus of claim 8 wherein required executable 
code is sought first in the computer on which the mobile 
agent is executing, then in the mobile codebase, and finally 

20 on the home codebase. 

10. The apparatus of claim 8 wherein a new thread is formed 
for execution of the mobile agent in the destination computer 
following receipt of the mobile agent, and wherein a security 

25 feature prevents the mobile agent from operating outside a 

scope assigned to such thread. 

11. The apparatus of claim 8 wherein the mobile agent 
further includes sub-objects. 

30 

12. The apparatus of claim 1 wherein a persistent local copy 
of the mobile agent is stored following receipt of the mobile 
agent, and wherein such copy is overwritten with an updated 
persistent copy following agent execution. 

35 
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13. In a computer network including at least a first 
computer and a second computer, a method for performing a 
task in a second computer, comprising the steps of: 

generating a mobile agent object in the first computer, 
the mobile agent including both data and executable code; 

transmitting the mobile agent from the first computer 
to the second computer; 

receiving the mobile agent in the second computer; and 

executing the mobile agent in the second computer in 
accordance with an itinerary which contains a reference to 
each destination computer to which the mobile agent is 
designated to migrate and a reference to a method associated 
with each respective destination computer reference, the 
method associated with the second computer being invoked when 
the mobile agent is present on the second computer. 

14. The method of claim 13 including the further step of 
serializing the mobile agent to generate a stream of data 
therefrom in the first computer. 

15. The method of claim 14 including the further step of 
deserializing the stream of bytes to regenerate the mobile 
agent therefrom in the second computer. 

16. The method of claim 13 wherein the task is data 
gathering, and including the further step of transmitting the 
mobile agent back to the first computer from the second 
computer following completion of such data gathering. 

17. The method of claim 13 including the further step of 
causing the mobile agent to sequentially migrate to a 
plurality of destination computers within the computer 
network . 

18. The method of claim 13 including the further seep of 
employing a Uniform Resource Locator as one of the at least 
one destination computer reference. 
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19. The method of claim 13 including the further step of 
retrieving at least a portion of the executable code required 
for invoking the method from a mobile codebase portion of the 
executable code included in the mobile agent. 

20. The method of claim 19 wherein the mobile agent includes 
a reference to a home codebase located on the first computer, 
and including the further step of employing the reference to 
retrieve required executable code which is not present in the 
mobile codebase. 

21. The method of claim 20 including the further step of 
searching for required executable code first in the computer 
on which the mobile agent is executing, then in the mobile 
codebase, and finally on the home codebase. 

22. The method of claim 21 including the further step of 
forming a new thread in the destination computer for 
execution of the mobile agent following receipt thereof, and 
wherein a security feature prevents the mobile agent from 
operating outside a scope assigned to such thread. 

23. The method of claim 21 including the further step of 
inserting sub-objects into the mobile agent. 

24. The method of claim 13 including the further step of 
storing a persistent local copy of the mobile agent following 
receipt thereof, and overwriting such copy with an updated 
persistent copy following agent execution. 

25. In a computer network including at least a first 
computer and a second computer, an apparatus for performing 
a task in a second computer, comprising: 

a routine that generates a mobile agent object in the 
first computer, the mobile agent including both data and 

executable code; 

a protocol for transmission of the mobile agent from the 
first computer to the second computer, wherein execution of 



WO 98/21662 PCT/US97/20232 

the mobile agent in the second computer following such 
transmission prompts the task to be performed in the second 
computer, at least a portion of the executable code required 
for execution being retrieved from a mobile codebase portion 
5 of the executable code included in the mobile agent; and 

a reference to a home codebase located on the first 
computer, the reference being employed to retrieve required 
executable code which is not present in the mobile codebase. 

10 26. The apparatus of claim 25 wherein the transmission 

protocol includes a routine in the first computer for 
serializing the mobile agent to generate a stream of data 
therefrom. 

15 27. The apparatus of claim 26 wherein the transmission 

protocol includes a routine in the second computer for 
deserializing the stream of bytes to regenerate the mobile 
agent therefrom. 

20 28. The apparatus of claim 25 wherein the task is data 

gathering, and wherein the mobile agent is transmitted back 
to the first computer from the second computer following 
completion of such data gathering. 

25 29. The apparatus of claim 25 wherein the mobile agent 

migrates to a plurality of destination computers within the 
computer network. 

30. The apparatus of claim 23 wherein the mobile agent 
30 further includes an itinerary containing a reference to each 

destination computer to which the agent is designated to 
migrate and a reference to a method associated with each 
respective destination computer reference, the respective 
method being invoked when the mobile agent is present on the 
35 respective destination computer. 

31. The apparatus of claim 30 wherein at least one 
destination comouter reference is a Uniform Resource Locator. 
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32. The apparatus of claim 25 wherein required executable 
code is sought first: in the computer on which the mobile 
agent is executing, then in the mobile codebase, and finally 

5 on the home codebase . 

33. The apparatus of claim 25 wherein a new thread is formed 
for execution of the mobile agent in the destination computer 
following receipt of the mobile agent, and wherein a security 

10 feature prevents the mobile agent from operating outside a 

scope assigned to such thread. 

34. The apparatus of claim 25 wherein the mobile agent 
further includes sub-objects. 



15 



20 



35 



35. The apparatus of claim 30 wherein a persistent local 
copy of the mobile agent is stored following receipt of the 
mobile agent, and wherein such copy is overwritten with an 
updated persistent copy following agent execution. 



36. In a computer network including at least a first 
computer and a second computer, a method for performing a 
task in a second computer, comprising the steps of: 

generating a mobile agent object in the first computer, 
25 the mobile agent including both data and executable code; 

transmitting the mobile agent from the first computer 
to the second computer; 

receiving the mobile agent in the second computer; 

retrieving at least a portion of the executable code 
30 required for invoking the method from a mobile codebase 

portion of the executable code included in the mobile agent; 

employing a reference to a home codebase located on the 
first computer to retrieve required executable code which is 
not oresent in the mobile codebase; and 



executing the mobile agent in the second computer such 
that the mobile agent prompts the task to be performed in the 
second comouter. 
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37. The method of claim 36 including the further step of 
serializing the mobile agent to generate a stream of data 
therefrom in the first computer. 

38. The method of claim 37 including the further step of 
deserializing the stream of bytes to regenerate the mobile 
agent therefrom in the second computer. 

39. The method of claim 36 wherein the task is data 
gathering, and including the further step of transmitting the 
mobile agent back to the first computer from the second 
computer following completion of such data gathering. 



40. The method of claim 36 including the further step of 
causing the mobile agent to sequentially migrate to a 
plurality of destination computers within the computer 
network . 

41. The method of claim 40 wherein the mobile agent further 
includes an itinerary which contains a reference to each 
destination computer to which the agent is designated to 
migrate and a reference to a method associated with each 
respective destination computer reference, and including the 
further step of invoking the method associated with the 
respective destination computer when the mobile agent is 
present on the respective destination computer. 



42. The method of claim 41 including the further step of 
employing a Uniform Resource Locator as one of the at least 

30 one destination computer reference. 

43. The method of claim 36 including the further step of 
searching for required executable code first in the computer 
on which the mobile agent is executing, then in the mobile 

3 5 codebase, and finally on the home codebase . 

44. The method of claim 36 including the further step of 
forming a new thread in the destination computer for 
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execution of the mobile agent following receipt thereof, and 
wherein a security feature prevents the mobile agent from 
operating outside a scope assigned to such thread. 

45. The method of claim 3 6 including the further step of 
inserting sub-objects into the mobile agent. 

46. The method of claim 41 including the further step of 
storing a persistent local copy of the mobile agent following 
receipt thereof, and overwriting such copy with an updated 
persistent copy following agent execution. 
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